Gramian Attention Heads are Strong yet Efficient Vision Learners

We introduce a novel architecture design that enhances expressiveness by incorporating multiple head classifiers (\ie, classification heads) instead of relying on channel expansion or additional building blocks. Our approach employs attention-based aggregation, utilizing pairwise feature similarity to enhance multiple lightweight heads with minimal resource overhead. We compute the Gramian matrices to reinforce class tokens in an attention layer for each head. This enables the heads to learn more discriminative representations, enhancing their aggregation capabilities. Furthermore, we propose a learning algorithm that encourages heads to complement each other by reducing correlation for aggregation. Our models eventually surpass state-of-the-art CNNs and ViTs regarding the accuracy-throughput trade-off on ImageNet-1K and deliver remarkable performance across various downstream tasks, such as COCO object instance segmentation, ADE20k semantic segmentation, and fine-grained visual classification datasets. The effectiveness of our framework is substantiated by practical experimental results and further underpinned by generalization error bound. We release the code publicly at: https://github.com/Lab-LVM/imagenet-models

Learning to Optimize Domain Specific Normalization for Domain Generalization

We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers that are specific to individual domains. Our approach employs multiple normalization methods while learning separate affine parameters per domain. For each domain, the activations are normalized by a weighted average of multiple normalization statistics. The normalization statistics are kept track of separately for each normalization type if necessary. Specifically, we employ batch and instance normalizations in our implementation to identify the best combination of these two normalization methods in each domain. The optimized normalization layers are effective to enhance the generalizability of the learned model. We demonstrate the state-of-the-art accuracy of our algorithm in the standard domain generalization benchmarks, as well as viability to further tasks such as multi-source domain adaptation and domain generalization in the presence of label noise

Enantioselective Alkynylation of Trifluoromethyl Ketones Catalyzed by Cation-Binding Salen Nickel Complexes

Cation‐binding salen nickel catalysts were developed for the enantioselective alkynylation of trifluoromethyl ketones in high yield (up to 99 %) and high enantioselectivity (up to 97 % ee). The reaction proceeds with substoichiometric quantities of base (10–20 mol % KOt‐Bu) and open to air. In the case of trifluoromethyl vinyl ketones, excellent chemo‐selectivity was observed, generating 1,2‐addition products exclusively over 1,4‐addition products. UV‐vis analysis revealed the pendant oligo‐ether group of the catalyst strongly binds to the potassium cation (K⁺) with 1:1 binding stoichiometry (K_a=6.6×10⁵ M⁻¹)

Origins of the developmental state in Korea: A social constructivist approach

Current literature on East Asia\u27s developmental state tends to overlook (1) the historical origins of state hegemony, (2) state-society relations in a non-Western, non-liberal context, (3) local-global interaction, and (4) changes in state hegemony over time. In so doing, development theorists inadvertently legitimate military despotic rule, and its attendant economically-efficient bureaucracy. Such reification distorts the picture of economic development in Korea. By focusing on non-Western and non-liberal state and society relations, this study argues that the legitimacy of the state\u27s intervention in the economy does not come solely from a contemporary regime of military dictatorship but from historically formulated Confucian state-society relations. In order to articulate such relations in Korea, this study applies Onuf\u27s paradigm of three different forms of rules and rule to three incarnations of Korea\u27s capital city. The thesis of this study provides us with an alternative to two current paradigms for explaining the unprecedented economic growth in Korea as well as in other Asian countries, neoclassical (neoliberal) and late developmentalist: market or state? It overcomes the oversimplification of attributing such economic growth to military dictatorship or an authoritarian state. Furthermore, it puts Confucianism into adequate perspective by showing how Confucianism functioned as a main source of state hegemony and state legitimacy, regulating economic activities, and has been modified since the Yi dynasty for the eventual formation of the modern developmental state in Korea. As a result, this study liberates us from a reductionist perspective toward Confucianism, especially in explaining the authoritarian political culture of Korea, and also from a journalistic perspective of treating Confucianism as merely a source of national characteristics of diligence, aspiration for higher education, and obedience. The second contribution of this study lies in its transcending a false dilemma: conversion to Western liberalism or incarceration by authoritarianism. By reconstructing the social rules that work differently from Western state-society relations, this study suggests the crafting of an indigenous model that is neither Western liberalism nor authoritarianism. The framework that this study utilizes would help us put non-dichotomous, non-confrontational complex interactions between state and society into adequate perspective, grounded in local reality, and would provide an adaptable and flexible framework which reflects the continuities and changes in the state-society relations

Modeling of Through-Silicon Via (TSV) Interposer Considering Depletion Capacitance and Substrate Layer Thickness Effects

To support the recent progress in 3-D integration based on through-silicon via (TSV) technology, an improved electromagnetic modeling method for TSVs is presented. In the framework of the mixed-potential integral equations combined with cylindrical modal basis functions, the proposed method can extract the effects of depletion capacitances and a finite substrate. To include the effects of depletion region generated by an external dc bias voltage, an additional capacitive cell is employed around a TSV. The proposed method also considers the effect from the finite silicon substrate accurately by employing the multilayered Green's functions. To reduce the computational cost for calculations involving Green's functions, a method to approximate Green's functions over localized intervals when computing partial potential coefficients is presented. The proposed method is validated for simple TSV examples and shows an improved accuracy with the acceptable usage of memory and simulation time. In addition, a 10 x 10 TSV array is modeled using different design parameters, showing the capability for dealing with larger size problems using this method.close1

Development of 17 polymorphic microsatellite loci from Jeju striped field mouse, Apodemus agrarius chejuensis (Rodentia: Muridae), by 454 pyrosequencing

Abstract Background The striped field mouse, Apodemus agrarius, is the most common mammal in Korea. Although microsatellite loci for the species have been identified from populations in southwestern China, amplification of those markers for Korean populations have been unsuccessful. The complicated taxonomy of Korean striped field mouse including populations on Jeju Island (A. a chejuensis) necessitates identification of additional molecular markers. Findings We applied 454 pyrosequencing systems to develop a suite of microsatellite markers. Muscle tissue was harvested and sequenced from 30 Jeju striped field mouse specimens which yielded 12,165 reads with a mean length per read of 287 bp. From these reads, we identified 17 microsatellite loci for A. a. chejuensis and tested these new markers against samples of both A. a chejuensis and A. a coreae, the mainland taxon. All 17 loci were amplified successfully for both taxa. Of the total 17 loci, one locus failed to amplify for a population on Heuksan Island. The cross-species transferability was also tested with the allied taxon, A. peninsulae and confirmed successful for 12 loci. Conclusions These newly developed markers will benefit studies of genetic structure, evolution, and resolving taxonomic problems of striped field mice and allied taxa in Korea

Indirect Contact Probing Method for Characterizing Vertical Interconnections in Electronic Packaging

This letter proposes a new indirect contact probing method to characterize vertical interconnections without contact damage. At the first step of the proposed technique, multiple one-port calibration measurements should be performed to characterize the contactor layer between the probe pads and the device-under-tests (DUTs). The characteristics of the actual vias as the DUTs are then extracted from indirect-contact measurements by de-embedding the contactor layer. In simulations and experiments at frequencies range from 2.5 to 18 GHz, we have verified via defects can be successfully identified from the indirect-contact measurements.close0